VEHICLE SURROUNDING AREA IMAGE SYSTEM 
BACKGROUND OF THE INVENTION 

Field of the Invention 

[0001] The present invention relates to a vehicle surrounding area imaging system that 
determines whether or not to display an image or image of a side of one's own automobile. 
Background Information 

[0002] Conventionally, technology that displays images of the rear side of one's own 
automobile is known. One example of such conventional technology is disclosed in 
Japanese Laid-Open Patent Publication No. 2000-238594. In this technology, a 
determination is made as to whether or not one's own automobile has entered into a region 
that requires an image display, that requires a display of an applicable image, (for example, 
an intersection) based on the driving actions of a driver. 

[0003] When the determination is made that one's own automobile has entered into 
the region that requires an image display, the technology photographs the rear side of 
one's own automobile to acquire an image of the rear side of the automobile and then 
displays the acquired image in a monitor inside the automobile cabin. This makes it 
possible for the driver of one's own automobile to view the image and verify the 
conditions at the rear sides of one's own automobile. 

[0004] In view of the above, it will be apparent to those skilled in the art from this 
disclosure that there exists a need for an improved vehicle surrounding area imaging 
system. This invention addresses this need in the art as well as other needs, which will 
become apparent to those skilled in the art from this disclosure. 

SUMMARY OF THE INVENTION 
[0005] It has been discovered that in this technology, when one's own automobile 
actually enters into the region that requires an image display, images of the sides of one's 
own automobile are often displayed. Consequently, the problem points shown below were 
encountered. In other words, when one's own automobile actually enters into the region 
that requires an image display, the driver is concentrating on driving the automobile and 
not on the image being displayed. Because of this, there was a problem of the driver 
having trouble viewing the image. 



[0006] The present invention intends to solve this type of conventional problem. One 
object of the present invention is to provide a vehicle surrounding area imaging system 
that allows a driver to easily view and verify images of road conditions. 
[0007] In accordance with one aspect of the present invention, a vehicle surrounding 
area imaging system is provided that basically comprises an image acquiring device, a 
position detecting device, a startup imaging device and an image displaying device. The 
image acquiring device is configured and arranged to acquire images of peripheral side 
areas of a vehicle equipped with the vehicle surrounding area imaging system. The 
position detecting device is configured and arranged to detect a current vehicle position of 
the vehicle. The startup imaging device is configured and arranged to detect 
predetermined road regions that require one of the images of the peripheral side areas of 
the vehicle to be displayed based on the current vehicle position detected by the position 
detecting device as well as map information. The image displaying device is configured 
and arranged to selectively display one of the images acquired by the image acquiring 
device before the vehicle enters into one of the predetermined road regions that was 
detected by the startup imaging device. 

[0008] These and other objects, features, aspects and advantages of the present 
invention will become apparent to those skilled in the art from the following detailed 
description, which, taken in conjunction with the annexed drawings, discloses preferred 
embodiments of the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] Referring now to the attached drawings which form a part of this original 
disclosure: 

[0010] Figure 1 is a block diagram showing main components of a vehicle 
surrounding area imaging system in accordance with a first embodiment of the present 
invention; 

[001 1] Figure 2 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 

[0012] Figure 3 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 



-2- 



[001 3] Figure 4 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 

[0014] Figure 5 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 

[001 5] Figure 6 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 

[0016] Figure 7 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 

[0017] Figure 8 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 

[0018] Figure 9 is a top plan view showing an example of one of the predetermined 
regions that require an image display of the surrounding area of the peripheral side of the 
vehicle; 

[0019] Figure 10 is a top plan view showing starting and stopping locations based on a 
prescribed distance for displaying an image of the surrounding area of the peripheral side 
of the vehicle prior to entering a predetermined region that require an image display of the 
surrounding area of the vehicle; 

[0020] Figure 1 1 is a flowchart showing the processing procedure according to the 
vehicle surrounding area imaging system; 

[0021] Figure 12 is a block diagram showing main components of a vehicle 
surrounding area imaging system related to another embodiment of the present invention; 
[0022] Figure 13 is a top plan view showing starting and stopping locations based on a 
prescribed time for displaying an image of the surrounding area of the peripheral side of 
the vehicle prior to entering a predetermined region that require an image display of the 
surrounding area of the vehicle; and 

[0023] Figure 14 is a flowchart showing the processing procedure according to the 
vehicle surrounding area imaging system. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0024] Selected embodiments of the present invention will now be explained with 
reference to the drawings. It will be apparent to those skilled in the art from this 
disclosure that the following descriptions of the embodiments of the present invention are 
provided for illustration only and not for the purpose of limiting the invention as defined 
by the appended claims and their equivalents. 

[0025] Generally, the present invention displays image information of the road 
conditions at least one of the peripheral sides of one's own automobile before one's own 
automobile enters into a predetermined road region that requires an image display of at 
least one of the peripheral sides of one's own automobile. In other words, before the 
driver concentrates on the driving actions in the predetermined road region that requires an 
image display of at least one of the peripheral sides of one's own automobile. This makes 
it possible for the driver of one's own automobile to view and verify images of the 
peripheral sides of one's own automobile before concentrating on the driving actions in 
the predetermined road region that requires an image display. As a result, the driver can 
more easily view and verify images of the sides of one's own automobile compared to 
conventional technology, which determines whether or not the automobile is in the 
predetermined road region that based on the driving actions of the driver. In other words, 
the driver can more easily verify the conditions at the peripheral sides of one's own 
automobile. 

FIRST EMBODIMENT 
[0026] Referring initially to Figure 1, a block diagram of the main components of a 
vehicle surrounding area imaging system la is illustrated in accordance with a first 
embodiment of the present invention. The vehicle surrounding area imaging system la is 
installed in one's own automobile or vehicle 100. The vehicle surrounding area imaging 
system la basically comprises a pair of cameras 1 la and 1 lb, a navigation system 12, a 
startup imaging determination unit 13 and a monitor 14. The cameras 11a and lib form 
an image acquiring device that is configured and arranged to photograph peripheral side 
areas of the vehicle 100 to acquire images of the peripheral side areas of the vehicle 100 
that include the so called blind spot that is not covered by the mirrors of the vehicle. The 
navigation system 12 forms a position detecting device that is configured and arranged to 
a current position of the vehicle 100 that detects the current position of the vehicle 100. 



The startup imaging determination unit 13 forms a startup imaging determination device 
that isconfigured and arranged to detect predetermined road regions that requires an image 
to be displayed of the periphery around the vehicle 100 based on the current position 
detected by the navigation system 12 (position detecting device) as well as map 
information. The monitor 14 forms an image displaying device that is configured and 
arranged to display the images acquired by the cameras 11a and lib (image acquiring 
device). 

[0027] The navigation system 12 and the startup imaging determination unit 13 can be 
separate units or an integrated system that utilizes common components. The startup 
imaging determination unit 13 is a control unit that preferably includes a microcomputer 
with a startup imaging control program that controls the monitor 14 as discussed below. 
The startup imaging determination unit 1 3 also include other conventional components 
such as an input interface circuit, an output interface circuit, and storage devices such as a 
ROM (Read Only Memory) device and a RAM (Random Access Memory) device. The 
memory circuits store data, processing results and control programs such as ones for 
determining operation of the monitor 1 4 based on map information, the current vehicle 
position and image information. The startup imaging determination unit 13 is operatively 
coupled to the cameras 11a and 1 lb, the navigation system 12 and the monitor 14 in a 
conventional manner. The internal RAM of the startup imaging determination unit 13 
stores statuses of operational flags and various control data. The internal ROM of the 
startup imaging determination unit 13 stores the predetermined or prescribe information 
for various operations. It will be apparent to those skilled in the art from this disclosure 
that the precise structure and algorithms for startup imaging determination unit 13 can be 
any combination of hardware and software that will carry out the functions of the present 
invention. In other words, "means plus function" clauses as utilized in the specification 
and claims should include any structure or hardware and/or algorithm or software that can 
be utilized to carry out the function of the "means plus function" clause. 
[0028] Initially, the composition of the vehicle surrounding area imaging system la 
related to the first embodiment and the principal features of the compositional elements 
will be described by referring to Figures 1-10. Here, Figure 1 is a block diagram 
showing the main components of the vehicle surrounding area imaging system la, while 
Figures 2 ~ 9 are top plan views showing examples of the predetermined road regions that 



require an image display. Figure 10 is a top plan view illustrating an image displaying 
location that is a prescribed distance dl prior to the predetermined road region that the 
vehicle is approaching. 

[0029] As shown in Figure 2, the camera 1 1 a photographs a region 1 10 at the left side 
of the vehicle 100 to acquire image information of the left peripheral side of the vehicle 
100. Then, the image information that was acquired is output to the startup imaging 
determination unit 13 shown in Figure 1. 

[0030] As shown in Figure 3, the camera 1 lb photographs a region 1 1 1 at the right 
side of the vehicle 100 to acquire image information of the right peripheral side of the 
vehicle 100. Then, the image information that was acquired is output to the startup 
imaging determination unit 13 shown in Figure 1. 

[003 1 ] The navigation system 1 2 uses GPS (Global Positioning System) to acquire 
current vehicle position information of the vehicle 100. In other words, the navigation 
system 12 is configured and arranged to detect the current vehicle position of the vehicle 
100. The navigation system 12 also preferably includes prestored map information of the 
area where the vehicle 100 is being driven. Then, the current vehicle position information 
that was acquired and the map information are output to the startup imaging determination 
unit 13. 

[0032] The navigation system 12 is further configured and arranged such that the 
driver can input a specific destination of the vehicle 100 that is outputted to the startup 
imaging determination unit 13. The navigation system 12 is further configured and 
arranged to set a specific route for the vehicle 100 to reach the inputted destination in 
response to the specified input operations (for example, input operations in which 
automobile passengers use input switches not shown in the figures). When the specific 
route is set, the applicable route information is generated for the route, and the route 
information is then outputted to the startup imaging determination unit 13. 
[0033] The startup imaging determination unit 13 is further configured and arranged to 
detect predetermined road regions that require an image display of the peripheral side area 
of one's own automobile, based on the current vehicle position information and map 
information provided from the navigation system 12. When a predetermined road region 
that requires an image display is detected, the image displaying location dl is determined 
for the predetermined road region that was detected as being approached by the vehicle 



100 as shown in Figure 10. The image displaying location dl is a prescribed distance, 
such as 30 meters. Here in Figure 10, a merge point 202, described later, is illustrated as 
an example of one of the predetermined road region that requires an image display. The 
image displaying location dl is the point where the monitor 14 starts displaying at least 
one of the images of the peripheral side areas of the vehicle 100. Thus, the driver can 
view the peripheral side areas of the vehicle 100 prior to entering the merge point 202 (the 
predetermined road region). In Figure 10, the beginning of the merge point 202 (the 
predetermined road region) is indicated by the startup location d2. At the startup location 
d2, the monitor 14 starts displaying one or more images that are determined by the 
particulars of the predetermined road region that the vehicle has entered. In other words, 
the image(s) on the monitor 14 can either remain the same, shift to new image(s) or the 
monitor can be turned off depending on the particulars of the predetermined road region. 
[0034] Then, a determination will be made as to whether or not the vehicle 100 passed 
the image displaying location dl that was detected based on the current position 
information and map information. When the result is that vehicle 100 passed the image 
displaying location dl, a determination will be made as to whether or not a specific route 
is uniquely specified by road configuration in the applicable region that requires an image 
display. When a specific route is uniquely specified by road configuration, the image 
information corresponding to the specified route will be output to the monitor 14. 
[0035] In contrast, when a specific route is not uniquely specified by road 
configuration and route information is provided from the navigation system 12, the current 
route of the vehicle 100 will be recognized based on that route information, the current 
position information and map information such that image information corresponding to 
that recognized route will output to the monitor 14. 

[0036] Further, when neither a specific route is uniquely specified by road 
configuration nor route information is provided from the navigation system 12, then the 
image information provided from both of the cameras 11a and 1 lb will output to the 
monitor 14. In other words, image information of both sides of the vehicle 100 will output 
to the monitor 14. 

[0037] The monitor 14 is installed inside the cabin of the vehicle 100 and displays 
image information provided from the startup imaging determination unit 13. The monitor 
14 is preferably configured and arranged to display multiple images at one time. Now, 



examples of predetermined road regions that require an image display will be described 
referring to Figures 2-9. The arrow 100a shown in Figures 2 ~ 9 indicates the current 
route of the vehicle 100. 

[0038] As shown in Figures 2 and 3, a merge point 202 is included as one of the 
predetermined road regions that require an image display to assist the driver in passing 
through the predetermined road region. This merge point 202 merges the road 200 (e.g., 
main road or principal trunk road of an expressway) and a road 201 (e.g., acceleration lane 
that merges a main road of an expressway or a feeder road that merges with a principal 
trunk road) that merges with one part of the road 200 to form one road. The reason the 
merge point 202 is included in the predetermined road regions that require an image 
display is as follows. As shown in Figure 2, when the vehicle 100 enters the merge point 
202 from the road 200, there is a chance that another automobile 101, traveling on the road 

201, may enter the merge point 202. Besides this, another automobile 102 may be 
traveling in the lane 203 at the outside of the merge point 202. 

[0039] As an example of this case, the driver of the vehicle 100 must verify the front 
of the vehicle 100 in order to confirm whether or not another automobile 101 is trying to 
cut ahead in the front of the vehicle 100. Even if another automobile 101 enters in the rear 
of the vehicle 100, the front of the vehicle 100 must be verified in order to confirm 
whether or not that the other automobile 101 has not entered at a dead angle (blind spot) 
when that other automobile 101 is a two-wheeled vehicle. 

[0040] In contrast, as shown in Figure 3, when the vehicle 100 enters the merge point 
202 from the road 201, there is a chance that the vehicle 100 might enter the merge point 
202 from the front of the other automobile 101 that is traveling in the merge point 202. 
Another automobile 102 is also traveling in the lane 203 at the outside of the merge point 

202. In this case, the driver must verify the right side of the vehicle 100 in order to 
confirm whether or not the other automobile 101 should be permitted to move ahead of the 
vehicle 100. Consequently, when the vehicle 100 enters the merge point 202, it may be 
necessary for the driver of the vehicle 100 to verify the side of the vehicle 100 (left side in 
Figure 2 and right side in Figure 3). Thus, the merge point 202 is included as one of the 
predetermined road regions that require an image display to assist the driver in passing 
through the predetermined road region or the merge point 202. 



[0041] As shown in Figure 4, a road 210 (e.g., main road or principal trunk road of an 
expressway) and a road 211 that merges with the road 210 (e.g., acceleration lane that 
merges a main road of an expressway or a feeder road that merges with a principal trunk 
road) define a merge point 212. This merge point 212 is also included as one of the 
predetermined road regions that require an image display to assist the driver in passing 
through the predetermined road region. The reason the merge point 212 is included in the 
predetermined road regions that require an image display is identical to the reason the 
merge point 202, shown in Figure 2, is included in the predetermined road regions that 
require an image display. 

[0042] Furthermore, as shown in Figure 5, a traffic circle or rotary is also included as 
one of the predetermined road regions that require an image display to assist the driver in 
passing through the predetermined road region. The traffic circle or rotary has a road 221 
around the periphery of a rotary unit 220 and a merge point 223 with a road 222 that 
merges with the road 221 . Each merge point of the traffic circle or rotary is included in as 
one of the predetermined road regions that require an image display. The reason this 
merge point 223 is included in as one of the predetermined road regions that require an 
image display is as follows. Namely, as shown in Figure 5, when the vehicle 100 enters 
the merge point 223, there is a possibility that another vehicle (in particular a two-wheeled 
vehicle 103) may enter the merge point 223 from the rear of the vehicle 100. In this case, 
the driver of the vehicle 100 must verify the side of the vehicle 100 in order that, for 
example, the automobile does not entangle the two-wheeled vehicle 103. Therefore, in 
this case, an image of the side of the vehicle 100 (left side in Figure 5) must be displayed 
in order for the driver to perform this verification. Thus, a traffic circle or rotary with its 
merge points are included in the predetermined road regions that require an image display. 
[0043] In addition, when a specific route is uniquely specified by road configuration 
for the vehicle 100 that passes through one of the predetermined road regions shown in 
Figures 2-5, the startup imaging determination unit 13 is configured and arranged to 
determine which of the images from the cameras 11a and 1 lb should be displayed prior to 
the vehicle 100 entering the predetermined road region. For each of the predetermined 
road regions shown in Figures 2-5, the startup imaging determination unit 13 is 
preferably configured and arranged to determine the image displaying location dl based 
on the particulars of the predetermined road regions. In other words, the startup imaging 



.* t « 

determination unit 13 can be configured and arranged to determine the image displaying 
location dl based on the type of predetermined road region such that certain types of 
merge points have different distance for the image displaying location dl. For example, 
the distance of the image displaying location dl from the predetermined road region for a 
highway is different from the distance of the image displaying location dl from the 
predetermined road region for a local road. Of course, in simpler version of the present 
invention, the distance of the image displaying location dl from the predetermined road 
region can be same regardless of the particulars of the predetermined road region. In any 
event, the driver can view the peripheral side areas of the vehicle 100 prior to entering the 
merge point 202 (the predetermined road region). In Figure 10, the beginning of the 
merge point 202 (the predetermined road region) is indicated by the startup location d2. 
At the startup location d2, the monitor 14 starts displaying one or more images that are 
determined by the particulars of the predetermined road region that the vehicle has entered. 
In other words, the image(s) on the monitor 14 can either remain the same, shift to new 
image(s) or the monitor 14 can be turned off depending on the particulars of the 
predetermined road region that the vehicle 100 has entered. 
[0044] As shown in Figure 6, an intersection 230 is included in one of the 
predetermined road regions that require an image display. The reason the intersection 230 
is included in one of the predetermined road regions that require an image display is as 
follows. Namely, as shown in Figure 6, when the vehicle 100 enters the intersection 230, 
there is a possibility that another vehicle (in particular a two-wheeled vehicle 103) may 
enter the intersection 230 from the rear of the vehicle 100. In this case, the driver of the 
vehicle 100 must verify the side of the vehicle 100 in order that, for example, the 
automobile does not entangle the two-wheeled vehicle 103. Therefore, in this case, an 
image of the side of the vehicle 100 (left side in Figure 6) must be displayed in order for 
the driver to perform this verification. Thus, the intersection 230 is included in one of the 
predetermined road regions that require an image display. 

[0045] In addition, as shown in Figure 7, a branch point 240, where roads branch out 
to multiple branch roads, is included in one of the predetermined road regions that require 
an image display. The reason the branch point 240 is included in the region that requires 
an image display is as follows. Namely, as shown in Figure 7, when the vehicle 100 
enters the branch point 240, there is a possibility that another vehicle (in particular a two- 
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wheeled vehicle 103) may enter the branch point 240 from the rear of the vehicle 100. In 
this case, the driver of the vehicle 100 must verify the side of the vehicle 100 in order that, 
for example, the automobile does not entangle the two-wheeled vehicle 103. Therefore, 
for this case, an image of the side of the vehicle 100 (left side in Figure 7) must be 
displayed in order for the driver to perform this verification. Thus, the branch point 240 is 
included in one of the predetermined road regions that require an image display. 
[0046] In addition, as shown in Figure 8, a branch point 250 between an overpass 251 
and a minor road 252 that extends to the side of the overpass 251 is included in one of the 
predetermined road regions that require an image display. The reason the branch point 
250 is included in one of the predetermined road regions that require an image display is 
as follows. Namely, as shown in Figure 8, when the vehicle 100 enters the branch point 
250, there is a possibility that another vehicle (in particular a two-wheeled vehicle 103) 
may enter the branch point 250 from the rear of the vehicle 100. In this case, the driver of 
the vehicle 100 must verify the side of the vehicle 100 in order that, for example, the 
automobile does not entangle the two-wheeled vehicle 103 when entering the minor road 
252 from the branch point 250. Therefore, for this case, an image of the side of the 
vehicle 100 (left side in Figure 8) must be displayed in order for the driver to perform this 
verification. Thus, the branch point 250 is included in one of the predetermined road 
regions that require an image display. 

[0047] In addition, as shown in Figure 9, a T-intersection 260 is included in one of the 
predetermined road regions that require an image display. The reason the T-intersection 
260 is included in one of the predetermined road regions that require an image display is 
as follows. Namely, as shown in Figure 9, when the vehicle 100 enters the T-intersection 
260, there is a possibility that another vehicle (in particular a two-wheeled vehicle 103) 
may enter the T-intersection 260 from the rear of the vehicle 100. In this case, the driver 
of the vehicle 100 must verify the side of the vehicle 100 in order that, for example, the 
automobile does not entangle the two-wheeled vehicle 103 when turning to the left on the 
T-intersection 260. Therefore, in this case, an image of the side of the vehicle 1 00 (left 
side in Figure 9) must be displayed in order for the driver to perform this verification. 
Thus, the T-intersection 260 is included in one of the predetermined road regions that 
require an image display. 



[0048] Moreover, when a specific route is not uniquely specified by road 
configuration specified for the vehicle 100, but a specific route is set as in Figures 6 — 9, 
then the startup imaging determination unit 13 still determines which of the images from 
the cameras 1 la and 1 lb should be displayed prior to the vehicle 100 entering the 
predetermined road region. In this case, the determination of the startup imaging 
determination unit 13 is based on a determination that the vehicle 100 will most likely pass 
through the predetermined road regions and the driver will most likely take a certain 
action such as turn right or left in view of the map information, the route information and 
the current vehicle location. In other words, the startup imaging determination unit 13 
determines that the vehicle 100 will most likely follow the guide route indicated by the 
arrows 100a in Figures 6 ~ 9. 

[0049] Next, Figure 1 1 uses a flowchart to describe the processing executed by the 
startup imaging determination unit 13 of the vehicle surrounding area imaging system la 
according to the present invention. 

[0050] In step SI 01 of Figure 11, when the ignition of the vehicle 100 is turned ON, 
the startup imaging determination unit 13, shown in Figure 1, turned on and the program 
continues to run as along as the ignition in the ON state. As a result, the processing by the 
startup imaging determination unit 13 proceeds to step SI 02, where the startup imaging 
determination unit 13 determines if the ignition is maintained in either the ON state or the 
OFF state. When the ignition is maintained in the OFF state, the vehicle surrounding area 
imaging system la ends the processing. When the ignition is maintained in the ON state, 
the vehicle surrounding area imaging system la proceeds to step SI 03. 
[0051] In step SI 03, the cameras 11a and lib photograph the peripheral regions at the 
sides of the vehicle 100 to acquire image information. Then, this acquired image 
information is output to the startup imaging determination unit 13, but not displayed on the 
monitor 14 until it is determine to be needed by the driver. Also in step SI 03, the 
navigation system 12 acquires current position information of the vehicle 100 and then 
acquires map information that includes the current vehicle position. Next, the acquired 
current position information and the map information are output to the startup imaging 
determination unit 13. 
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[0052] Additionally, when the route of the vehicle 100 is set, the navigation system 12 
generates route information for this set route and outputs that information to the startup 
imaging determination unit 13. 

[0053] Next, in step SI 04, the startup imaging determination unit 13 detect the next 
predetermined road region that requires an image display from the periphery around the 
vehicle 100 based on the current vehicle position information and the map information 
provided from the navigation system 12. Also calculates the imaging displaying location 
dl for starting the monitor 14 to display one or more of the images from the cameras 11a 
and lib. 

[0054] Next, in step SI 05, the startup imaging determination unit 13 determines if the 
vehicle 100 has passed the imaging displaying location dl for starting the monitor 14 to 
display one or more of the images from the cameras 11a and lib based on the current 
vehicle position information and the map information provided from the navigation system 
12. As a result, when the vehicle 100 passed the imaging displaying location dl , then the 
process will proceed to step SI 06. If the vehicle 100 did not pass the imaging displaying 
location dl, then the process will return to step SI 02. 

[0055] In step SI 06, the startup imaging determination unit 13 determines whether or 
not the vehicle 100 has passed through the predetermined road region that requires an 
image display based on the current position information and map information provided 
from the navigation system 12. As a result, when the vehicle 100 passed the 
predetermined road region, the process will proceed to step SI 07. If the vehicle 100 did 
not pass the predetermined road region, the process will proceed to step SI 08. 
[0056] In step SI 07, the startup imaging determination unit 13 stops the output of 
image information to the monitor 14 based on the startup imaging determination unit 13. 
Consequently, the monitor 14 stops the display of image information based on the startup 
imaging determination unit 13. Thereafter, the vehicle surrounding area imaging system 
la returns to step S102. However, the monitor 14 can still display image(s) from the 
cameras 11a and 1 lb, if needed and desired, such that the image(s) from the cameras 11a 
and 1 lb are turned off after a predetermined time or distance from exiting the 
predetermined road region based on the current vehicle position information and the map 
information provided from the navigation system 12. 
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[0057] In step SI 08, the startup imaging determination unit 13 determines whether or 
not the route of the vehicle 100 is uniquely specified by road configuration in the 
predetermined road region that requires an image display based on the current position 
information and the map information provided from the navigation system 12. In other 
words, in step SI 08, the startup imaging determination unit 13 determines whether or not 
there is only one route for the vehicle 100 or if there are multiple routes for the vehicle 
100 through a predetermined road region. As a result, when a specific route is uniquely 
specified by the road configuration, then the process proceeds to step SI 09. When the 
route is not uniquely specified (for example, as shown in Figures 6 ~ 9), then the process 
proceeds to step SI 10. 

[0058] In step SI 09, the startup imaging determination unit 13 outputs the image 
information to the monitor 14 that corresponds to the specified route from among image 
information provided from the cameras 11a and lib. For example in Figure 2, only the 
image information on the left side of the vehicle 100 is necessary. Thus, when vehicle 100 
approaches a predetermined road region such as in Figure 2, only the image information 
provided from the camera 1 la is outputted to the monitor 14. 

[0059] Next, the monitor 14 displays the image information provided from the startup 
imaging determination unit 13. Because of this, the driver of the vehicle 100 views and 
verifies the displayed image information thereby making it possible to know the condition 
at the sides of the automobile that correspond to the route of the vehicle 100. 
[0060] In contrast, when the route is not uniquely specified, the startup imaging 
determination unit 1 3 determines whether or not route information has been provided from 
the navigation unit 12 in step SI 10. As a result, when the route information has been 
provided, the process proceeds to step Sill. If the route information has not been 
provided, the process proceeds to step SI 12. 

[0061] In step Sill, the startup imaging determination unit 13 recognizes the 
specified route of the vehicle 100 based on the route information provided from the 
navigation system 1 2 and then outputs image information that corresponds to the 
recognized route, from among image information provided from the cameras 1 1 a and lib 
to the monitor 14. For example, as shown in Figure 6, when the route of the vehicle 100 is 
set to the route indicated by the arrows 100a, the image information acquired by camera 
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1 la, from among image information provided from the cameras 11a and 1 lb, will output 
to the monitor 14. 

[0062] Next, the monitor 14 displays the image information provided from the startup 
imaging determination unit 13. Because of this, the driver of the vehicle 100 views and 
verifies the displayed image information thereby making it possible to know the condition 
at the sides of the automobile that correspond to the route of the vehicle 100. Thereafter, 
the vehicle surrounding area imaging system la returns to step SI 02. 
[0063] In step SI 12, the startup imaging determination unit 13 outputs image 
information provided from the cameras 11a and 1 lb to the monitor 14. In other words, 
image information of both sides of the vehicle 100 will output to the monitor 14. 
[0064] Next, the monitor 14 displays the image information provided from the startup 
imaging determination unit 13. Because of this, the driver of the vehicle 100 views and 
verifies the displayed image information thereby making it possible to know the condition 
at both sides of the vehicle 100. Thereafter, the vehicle surrounding area imaging system 
la returns to step SI 02. 

[0065] As described above, in the first embodiment, when the vehicle surrounding 
area imaging system la detects a predetermined road region that requires an image display, 
image information acquired by the cameras 11a and lib will display before the vehicle 
100 enters this detected predetermined road region that requires an image display (refer to 
step SI 05 ~ step SI 12 shown in Figure 11). 

[0066] This makes it possible for the driver of the vehicle 100 to view and verify 
image information of the sides of the vehicle 100 before the vehicle 100 enters a 
predetermined road region that requires an image display, namely, before the driver 
focuses on driving actions in the region that requires an image display. Consequently, the 
driver can more easily view and verify image information of the sides of the vehicle 100 
compared to conventional technology that determines whether or not a predetermined road 
region that requires an image display exists based on the driving actions of the driver. In 
other words, the driver can more easily verify the condition at the sides of the vehicle 100. 
[0067] Furthermore, because the vehicle surrounding area imaging system la 
determines whether or not a predetermined road region that requires an image display 
exists based on map data, a more accurate determination can be made as to whether or not 
a region that requires an image display exists compared to conventional technology. This 
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makes it possible to display images of the sides of the vehicle 100 with even more 
accuracy. 

[0068] As shown in Figures 2 ~ 4, the merge points 202 and 212, where multiple roads 
merge, are included in the predetermined road region that requires an image display. This 
makes it possible for the driver to view and verify image information of the sides of the 
vehicle 100 before the driver focuses on driving actions in the merge points 202 and 212 
(for example, as shown in Figure 3, driving actions that enter the automobile onto the road 
200 after verifying the movement of the other automobile 101). 

[0069] As shown in Figure 5, a road 221 around the periphery of a rotary unit 220 and 
a merge point 223 with a road 222 are included in the predetermined road regions that 
require an image display. This makes it possible for the driver to view and verify image 
information of the sides of the vehicle 100 before the driver focuses on driving actions at 
the merge point 223 (for example, driving actions that enter the automobile onto the road 
221 after verifying the movement of a two-wheeled vehicle 103). 

[0070] As shown in Figure 6, an intersection 230 is included in the region that requires 
an image display. This makes it possible for the driver to view and verify image 
information of the sides of the vehicle 100 before the driver focuses on driving actions at 
the intersection 230 (for example, driving actions that turn the automobile left onto the 
intersection 230 after verifying the movement of a two-wheeled vehicle 103). 
[0071] As shown in Figure 7, a branch point 240 included in the predetermined road 
regions that require an image display. This makes it possible for the driver to view and 
verify image information of the sides of the vehicle 100 before the driver focuses on 
driving actions at the branch point 240 (for example, driving actions that turn the 
automobile onto a left branch road from the branch point 240 after verifying the 
movement of a two-wheeled vehicle 103). 

[0072] As shown in Figure 8, a branch point 250 where the road branches to a minor 
road 252 that extends to an overpass 251 and to the side of the overpass 251 is included in 
the predetermined road regions that require an image display. This makes it possible for 
the driver to view and verify image information of the sides of the vehicle 100 before the 
driver focuses on driving actions at the branch point 250 (for example, driving actions that 
enter the automobile onto the minor road 252 after verifying the movement of a two- 
wheeled vehicle 103). 
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[0073] As shown in Figure 9, a T-intersection 260 is included in the predetermined 
road regions that require an image display. This makes it possible for the driver to view 
and verify image information of the sides of the vehicle 100 before the driver focuses on 
driving actions at the T-intersection 260 (for example, driving actions that turn the 
automobile left onto the T-intersection 260 after verifying the movement of a two-wheeled 
vehicle 103). 

[0074] Furthermore, when the route of the vehicle 100 is uniquely specified in one of 
the predetermined road regions that require an image display, the vehicle surrounding area 
imaging system la displays image information of the side of the automobile corresponding 
to the specified route from among image information acquired by the cameras 11a and 1 lb 
(refer to step SI 09 shown in Figure 11). This makes it possible for the driver to only view 
and verify image information that requires viewing. 

[0075] In addition, when the route of the vehicle 100 is not uniquely specified in a 
predetermined road region that requires an image display and the navigation system 12 has 
not set a route for the vehicle 100, the vehicle surrounding area imaging system la 
displays image information acquired by the cameras 11a and lib, namely, image 
information of both sides of the vehicle 100 (refer to step SI 12 shown in Figure 11). This 
makes it possible for the driver to reliably view and verify image information of the sides 
of the vehicle 100 even if a route for the vehicle 100 is not uniquely specified in a 
predetermined road region that requires an image display. 

[0076] When the navigation system 12 has set a route for the vehicle 100, the vehicle 
surrounding area imaging system la displays image information of the sides 
corresponding to the set route from among image information acquired by the cameras 11a 
and 1 lb. This makes it possible for the driver to only view and verify image information 
that requires viewing even if a route for the vehicle 100 is not uniquely specified in a 
predetermined road region that requires an image display. 

[0077] When the vehicle 100 passes an image displaying location that is a prescribed 
distance prior to the predetermined road region, the vehicle surrounding area imaging 
system la displays image information acquired by the cameras 11a and 1 lb (refer to step 
SI 05 ~ Step SI 12 shown in Figure 11). Consequently, since the vehicle surrounding area 
imaging system la reliably displays image information of the sides of the vehicle 100 
before the vehicle 100 enters into a predetermined road region that requires an image 
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display, the driver can reliably view and verify that image information before the vehicle 
100 enters into a predetermined road region that requires an image display. 

SECOND EMBODIMENT 
[0078] Referring now to Figures 12 and 13, a startup determination system in 
accordance with a second embodiment will now be explained (corresponding to claim 1 2). 
In view of the similarity between the first and second embodiments, the parts of the 
second embodiment that are identical to the parts of the first embodiment will be given the 
same reference numerals as the parts of the first embodiment. Moreover, the descriptions 
of the parts of the second embodiment that are identical to the parts of the first 
embodiment may be omitted for the sake of brevity. 

[0079] First, the main components of the vehicle surrounding area imaging system lb 
related to the second embodiment and the principal features of the compositional elements 
will be described referring to Figures 12 and 13. In Figure 12, a block diagram shows the 
composition of the vehicle surrounding area imaging system lb. Figure 13 shows a top 
plan view of a predetermined road condition in which the image displaying location is 
based on a prescribed time. 

[0080] As shown in Figure 12, the vehicle surrounding area imaging system lb 
basically comprises a pair of cameras 11a and 1 lb, a navigation system 12, a startup 
imaging determination unit 13, a monitor 14 and a vehicle speed sensor 15. The cameras 
1 la and 1 lb form an image acquiring device that is configured and arranged to photograph 
peripheral side areas of the vehicle 100 to acquire images of the peripheral side areas of 
the vehicle 100 that include the so called blind spot that is not covered by the mirrors of 
the vehicle. The navigation system 12 forms a position detecting device that is configured 
and arranged to a current position of the vehicle 100 that detects the current position of the 
vehicle 100. The startup imaging determination unit 13 forms a startup imaging 
determination device that is configured and arranged to detect predetermined road regions 
that requires an image to be displayed of the periphery around the vehicle 100 based on 
the current position detected by the navigation system 12 (position detecting device) as 
well as map information. The monitor 14 forms an image displaying device that is 
configured and arranged to display the images acquired by the cameras 11a and 1 lb 
(image acquiring device). The vehicle speed sensor 15 forms vehicle speed detecting 
device is configured and arranged to detect the current vehicle speed. Further, the vehicle 
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surrounding area imaging system lb is installed in the vehicle 100 shown in Figure 2 in 
like manner to the vehicle surrounding area imaging system la related to the first 
embodiment. 

[0081] Because of this, the vehicle surrounding area imaging system lb comprises 
compositional elements identical to the vehicle surrounding area imaging system 1 a and in 
addition comprises the vehicle speed sensor 15. Consequently, only the areas different 
from the vehicle surrounding area imaging system la will be described for the vehicle 
surrounding area imaging system lb. 

[0082] The vehicle speed sensor 15 detects the speed of the vehicle 100, generates 
speed information related to the detected speed and then outputs that information to the 
startup imaging determination unit 13. 

[0083] The startup imaging determination unit 13 detects a predetermined road region 
that requires an image display that requires a display of an image of the side of the 
automobile from the periphery around the vehicle 1 00 based on the current position 
information and map information provided from the navigation system 12. 
[0084] As a result, when a predetermined road region that requires an image display is 
detected, the startup imaging determination unit 13 measures the distance the vehicle 100 
traveled in a prescribed time (for example, 3 seconds) based on speed information 
provided from the vehicle speed sensor 15. Then, as shown in Figure 13, the startup 
imaging determination unit 13 detects an image displaying location dl that is a prescribed 
time prior to the startup location d2. Thus, the image displaying location dl is separated 
by a measured distance away from the startup location d2 of the predetermined road 
region that requires an image display that was detected based on map information 
provided from the navigation system 12 (refer to Figure 13). 

[0085] Then, the startup imaging determination unit 13 determines whether or not the 
vehicle 100 has passed the image displaying location dl based on the current position 
information and map information provided from the navigation system 12. As a result, 
when the vehicle 100 passed the image displaying location dl, the startup imaging 
determination unit 1 3 determines whether or not a route is uniquely specified in the 
predetermined road region that requires an image display. As a result, when a route is 
uniquely specified, the startup imaging determination unit 13 outputs to the monitor 14 the 
image information corresponding to the specified route. 
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[0086] In contrast, when a route is not specified and route information is provided 
from the navigation system 12, the startup imaging determination unit 13 recognizes the 
route of the vehicle 100 based on that route information and outputs to the monitor 14 the 
image information corresponding to the specified route. 

[0087] Further, when a route is not specified and route information is not provided 
from the navigation system 12, the startup imaging determination unit 13 outputs to the 
monitor 14 the image information provided from the cameras 11a and 1 lb. In other words, 
the startup imaging determination unit 13 outputs image information of both sides of the 
vehicle 100 to the monitor 14. 

[0088] Next, the flowchart shown in Figure 14 will be used to describe the processing 
procedure according to the vehicle surrounding area imaging system lb. 
[0089] In steps S201 ~ S203 in Figure 14, the vehicle surrounding area imaging 
system lb performs processing identical to steps S101~S103in Figure 11. 
[0090] Next, in step S204, the vehicle speed sensor 15 detects the speed of the vehicle 
100, generates speed information related to the detected vehicle speed and then outputs 
that information to the startup imaging determination unit 13. 
[0091] Next in step S205, the startup imaging determination unit 13 detects the 
predetermined road region that requires an image display from the periphery around the 
vehicle 100 based on the current position information and map information provided from 
the navigation system 12. Also, in step S205, the startup imaging determination unit 13 
measures the distance the vehicle 100 traveled in a prescribed time based on speed 
information provided from the vehicle speed sensor 15. From this data, as shown in 
Figure 13, the startup imaging determination unit 13 calculates the imaging displaying 
location dl for starting the monitor 14 to display one or more of the images from the 
cameras 11a and lib based on map information provided from the navigation system 12. 
[0092] Then, in step S206, the startup imaging determination unit 13 determines if the 
vehicle 100 has passed the imaging displaying location dl for starting the monitor 14 to 
display one or more of the images from the cameras 1 la and 1 lb based on the current 
vehicle position information and the map information provided from the navigation system 
12. As a result, when the vehicle 100 passed the imaging displaying location dl, then the 
process will proceed to step S207. If the vehicle 100 did not pass the imaging displaying 
location dl, then the process will return to step S202. Thus, in this embodiment, the 
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system can determine the amount of time that the monitor 14 is displaying the image prior 
to the vehicle entering the predetermined road region. 

[0093] In steps S207 ~ S213, the vehicle surrounding area imaging system lb 
performs processing identical to steps S 106 ~ SI 12 in Figure 1 1. 

[0094] As described above, in the second embodiment, the following effects can be 
obtained in addition to the effects identical to the first embodiment that could be obtained. 
[0095] In other words, when a predetermined road region that requires an image 
display is detected, the vehicle surrounding area imaging system lb measures the distance 
the vehicle 100 traveled in a prescribed time based on the speed of the vehicle 100 
detected by the vehicle speed sensor 15. Then, the vehicle surrounding area imaging 
system lb detects the imaging displaying location dl for starting the monitor 14 to display 
one or more of the images from the cameras 11a and lib before entering the next 
predetermined road region that requires an image display . In other words, when the 
vehicle 100 passed the imaging displaying location dl, the vehicle surrounding area 
imaging system lb displays image information acquired by the cameras 11a and 1 lb. 
[0096] Consequently, because the vehicle surrounding area imaging system lb can 
display image information of the sides of the vehicle 100 before the vehicle 100 enters into 
a predetermined road region that requires an image display, the driver can view and verify 
that image information before the prescribed time in which the vehicle 100 enters into the 
predetermined road region that requires an image display. To put in different terms, the 
vehicle surrounding area imaging system lb can reliably ensure the prescribed time 
irregardless of the speed of the vehicle 100 as the time the driver views and verifies that 
image information. Further, the driver recognizing that prescribed time also makes it 
possible to recognize the time from the current time until the vehicle 100 enters into the 
predetermined road region that requires an image display. 

[0097] Additionally, the predetermined road region that requires an image display 
shown in the first and second embodiments is an example of a predetermined road region 
that requires an image display. The predetermined road region that requires an image 
display can also include other locations such as a gas station or parking garage along roads. 
[0098] As used herein to describe and claim the present invention, the following 
directional terms "forward, rearward, above, downward, vertical, horizontal, below and 
transverse" as well as any other similar directional terms refer to those directions of a 
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vehicle equipped with the present invention. Accordingly, these terms, as utilized to 
describe the present invention should be interpreted relative to a vehicle equipped with the 
present invention. Also, the term "configured" as used herein to describe and claim a 
component, section or part of a device includes hardware and/or software that is 
constructed and/or programmed to carry out the desired function. Moreover, terms that 
are expressed as "means-plus function' 1 in the claims should include any structure that can 
be utilized to carry out the function of that part of the present invention. The terms of 
degree such as "substantially", "about" and "approximately" as used herein mean a 
reasonable amount of deviation of the modified term such that the end result is not 
significantly changed. For example, these terms can be construed as including a deviation 
of at least ± 5% of the modified term if this deviation would not negate the meaning of the 
word it modifies. 

[0099] This application claims priority to Japanese Patent Application No. 2003- 
133670. The entire disclosure of Japanese Patent Application No. 2003-133670 is hereby 
incorporated herein by reference. 

[00100] While only selected embodiments have been chosen to illustrate the present 
invention, it will be apparent to those skilled in the art from this disclosure that various 
changes and modifications can be made herein without departing from the scope of the 
invention as defined in the appended claims. Furthermore, the foregoing descriptions of 
the embodiments according to the present invention are provided for illustration only, and 
not for the purpose of limiting the invention as defined by the appended claims and their 
equivalents. Thus, the scope of the invention is not limited to the disclosed embodiments. 
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